Handheld display apparatus

ABSTRACT

A handheld display apparatus including a display unit that displays an image includes a handheld grip portion including a plurality of bar members to be gripped by a user, and an operation unit that receives a manual operation and generates a control signal for the handheld display apparatus, the operation unit arranged on either at least one of the plurality of bar members or in proximity to at least one of the plurality of bar members.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation, and claims the benefit, of U.S.patent application Ser. No. 15/194,313 filed Jun. 27, 2016, which claimsthe benefit of Japanese Patent Application No. 2015-132189, filed Jun.30, 2015. Each of U.S. patent application Ser. No. 15/194,313 andJapanese Patent Application No. 2015-132189 is hereby incorporated byreference herein in its entirety.

BACKGROUND Field

Aspects of the present invention generally relate to a handheld displayapparatus that includes a display unit for displaying an image and ahandheld grip portion including a plurality of bar members to be grippedby a user.

Description of the Related Art

Head mounted apparatuses (HMD) exist that include a display unit fordisplaying an image and are able to be mounted onto a user's head. TheHMD can present a video image of, for example, a virtual object to amoving user. The HMD has recently come to be used in various fields.

If one HMD is used by a plurality of people, the HMD's mount portionneeds to be adjusted each time a different user uses the HMD. This canimpair the usability for the users.

Japanese Patent Application Laid-Open No. 2007-72120 discusses ahandheld display apparatus as a technique for allowing a plurality ofusers to easily take turns using an apparatus including a display unit.The handheld display apparatus discussed in Japanese Patent ApplicationLaid-Open No. 2007-72120 includes a display unit for displaying an imageand a grip portion arranged under the display unit. To view the image onthe display unit, the user grips the grip portion with both hands orwith one hand and looks into the display unit. The display unit ispositioned by the user by moving the handheld display apparatus whilethe user grips the grip portion. There is no need to adjust a mount unitin using the handheld display apparatus, thus, a plurality of users caneasily take turns using the handheld display apparatus.

When a user uses the handheld display apparatus discussed in JapanesePatent Application Laid-Open No. 2007-72120, one or both of the user'shands are occupied and not available for purposes other than grippingthe grip portion. As a result, while using the handheld displayapparatus, if the user needs to provide a control instruction, such aspowering the handheld display apparatus on or off, turning on or off ofa display, adjust the display contrast, perform an error recovery, etc.,the user needs to temporarily stop using the HMD, release the user'shand(s) from the grip portion, and perform the required operation. Theneed to stop using the handheld display apparatus each time a controlinstruction needs to be given can impair the user's usability of thehandheld display apparatus. In addition, frequently releasing and thenre-gripping the grip portion can cause an erroneous operation.

SUMMARY

Aspects of the present invention are generally directed to a techniquefor facilitating the issuance of a control instruction to a handhelddisplay apparatus that includes a display unit for displaying an imageto a user.

According to an aspect of the present invention, a handheld displayapparatus including a display unit configured to display an imageincludes a handheld grip portion including a plurality of bar members tobe gripped by a user and an operation unit configured to receive amanual operation and generate a control signal for the handheld displayapparatus, the operation unit arranged on either at least one of theplurality of bar members or in proximity to at least one of theplurality of bar members.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating a handheld mode of a handheld displayapparatus.

FIG. 2 is a diagram illustrating a head mounted mode of the handhelddisplay apparatus.

FIGS. 3A and 3B are diagrams each illustrating an appearance of thehandheld display apparatus.

FIGS. 4A and 4B are diagrams each illustrating an appearance of ahandheld unit used in the handheld mode.

FIGS. 5A, 5B, and 5C are diagrams each illustrating a mechanism formechanically transmitting an operation performed on buttons on ahandheld unit.

FIGS. 6A, 6B, and 6C are diagrams illustrating a mechanism forelectrically transmitting an operation performed on buttons on ahandheld unit in a wired manner.

FIGS. 7A, 7B, and 7C are diagrams illustrating a mechanism forelectrically wirelessly transmitting an operation performed on buttonson a handheld unit.

DESCRIPTION OF THE EMBODIMENTS

A handheld display apparatus according to an exemplary embodiment willbe described below. The handheld display apparatus according to thepresent exemplary embodiment includes an imaging unit that captures animage of a real space as well as a display unit that displays an imageto a user. In another embodiment, the handheld display apparatus can beconfigured to include only the display unit without the imaging unit.

When using the handheld display apparatus, the user is able to observe ascene in the direction of the user's line of sight via the imaging unitand the display unit.

Specific processing of the handheld display apparatus will now bedescribed. The handheld display apparatus initially obtains a real spaceimage captured by the imaging unit. The handheld display apparatus thensuperimposes, if needed, a virtual object (such as computer graphics)and/or another real space image on the obtained real space image. Thehandheld display apparatus finally presents the image that has undergonethe superimposition processing to the user on the display unit. If theforegoing processing is performed at sufficiently high speed, areal-time video image can be displayed to the user. Specific suitableuse cases include, but are not limited to, development use applicationsfor evaluating parts without prototyping, practice use applications forrare disasters, entertainment use applications, etc.

The present exemplary embodiment is also applicable to a handhelddisplay apparatus that does not include the imaging unit and the displayunit and that stimulates a non-visual sensory organ of a user's head.For example, the present exemplary embodiment is applicable to a soundguide device for guiding a visually-challenged user by voice and ahandheld display apparatus that includes a main body unit such as adevice for artificially producing a smell to enhance reality of avirtual object.

FIG. 1 illustrates a handheld mode of the handheld display apparatusaccording to the present exemplary embodiment. As illustrated in FIG. 1,the handheld mode refers to a state in which an imaging display unit 100is coupled with a handheld unit 200. The imaging display unit 100includes the imaging unit and the display unit, and can present an imagecaptured by the imaging unit to the user by using the display unit. Thehandheld unit 200 includes a handheld grip portion including a pluralityof bar members, and is gripped by the user. The imaging display unit 100and the handheld unit 200 include an attachment/detachment mechanism(attachment/detachment unit) therebetween, and can be manually attachedto and detached from each other.

The user can grip and hold the handheld unit 200 in the user's hands toview the image displayed on the imaging display unit 100 in front of theuser's eyes without mounting the imaging display unit 100 on the user'shead.

FIG. 2 illustrates a head mounted mode of the handheld display apparatusaccording to the present exemplary embodiment. As illustrated in FIG. 2,the head mounted mode refers to a state in which the imaging displayunit 100 is coupled with a head mount unit 300. The user can place thehead mount unit 300 on the user's head to view the image displayed onthe imaging display unit 100 in front of the user's eyes without the aidof the user's hands.

FIGS. 3A and 3B illustrate an appearance of the handheld displayapparatus according to the present exemplary embodiment. FIG. 3A is aperspective view of the handheld display apparatus according to thepresent exemplary embodiment from the front. As illustrated in FIG. 3A,the handheld display apparatus according to the present exemplaryembodiment includes the imaging display unit 100 including a built-inimaging unit, and the imaging display unit 100 includes a front cover140, a rear cover 120, a cable 150, and a button 160. The front cover140 is made of a transparent or semitransparent member or has a hole.With such a configuration, the imaging unit can capture an image of thereal space in front via the front cover 140. The cable 150 is used tosupply power to the imaging display unit 100 and perform communicationwith an external apparatus. If button 160 is manually operated by theuser, a control signal is generated and various controls, such as atransition of a state of the imaging display unit 100, are performed. Aposition and function of the button 160 will be described in detailbelow.

FIG. 3B is a perspective view of the handheld display apparatusaccording to the present exemplary embodiment from behind the handhelddisplay apparatus. As illustrated in FIG. 3B, the rear cover 120occupies a large area of the rear side. Similar to the front cover 140,the rear cover 120 is made of a transparent or semitransparent member orhas a hole. The user can view images displayed on display units 110 viathe rear cover 120. The display units 110 may include a projectionoptical system and/or a reflection optical system in addition to displaydevices.

A first coupling unit 130 is arranged on the rear cover 120. The firstcoupling unit 130 includes first rails 131, a first support surface 132,and a first projection catch portion 133. The first coupling unit 130 isused in coupling the imaging display unit 100 with the handheld unit200, or in coupling the imaging display unit 100 with the head mountunit 300. Details will be described below.

FIGS. 4A and 4B illustrate an appearance of the handheld unit 200 usedin the handheld mode according to the present exemplary embodiment. FIG.4A is a perspective view of the handheld unit 200 used in the handheldmode from a first point of view. The handheld unit 200 includes a secondcoupling unit 210 and a grip portion 220. The user can grip the gripportion 220 in both hands or in one hand. FIG. 4B is a perspective viewof the handheld unit 200 used in the handheld mode from a point of viewdifferent from the first point of view. The user's head contacts theside illustrated in FIG. 4B. As illustrated in FIG. 4B, there isprovided a second elastic member 230. If the user views the imagesdisplayed on the display units 110 of the imaging display unit 100, theuser presses a portion of the user's forehead against the second elasticmember 230. The elasticity of the elastic member 230 eases stressconcentration on the forehead so that the usability for the user doesnot deteriorate. If the user grips the grip portion 220 and brings theuser's forehead into contact with the second elastic member 230, theimaging display unit 100 is supported by two-points so that thepositional relation between the imaging display unit 100 and the user'shead is prevented from moving.

Next, operations for coupling and separating the imaging display unit100 with and from the handheld unit 200 will be described.

As illustrated in FIG. 4A, the second coupling unit 210 includes secondrails 211, a second support surface 212, a second lever 213, and asecond projection 214.

Initially, to couple the imaging display unit 100 with the handheld unit200, the imaging display unit 100 is moved above the handheld unit 200and the first rails 131 are positioned above the second rails 211. Theposition of the imaging display unit 100 is then lowered with the firstrails 131 and pressed against the second coupling unit 210. As a result,the first rails 131 and the second rails 211 engage with each other. Thesecond projection 214 is an elastic member, or is elastically deformablysupported by elastic force from another elastic member. When the imagingdisplay unit 100 is further lowered with the first and second rails 131and 211 engaged with each other, the second projection 214 is pushed tothe side of the second elastic member 230 by the first coupling unit130. When the imaging display unit 100 is further lowered with thesecond projection 214 pushed aside, the first support surface 132 comesinto contact with the second support surface 212. With the first andsecond support surfaces 132 and 212 contacting each other, the secondprojection 214 pushed aside comes into the space above the firstprojection catch portion 133 by resilience. The second projection 214and the first projection catch portion 133 are sloped in a direction ofengaging with each other. The imaging display unit 100 and the handheldunit 200, if coupled, are firmly positioned by the engagement of thefirst and second rails 131 and 211 and the engagement of the secondprojection 214 and the first projection catch portion 133. With such anoperation, the imaging display unit 100 and the handheld unit 200 can becoupled with each other.

Next, a case of separating the imaging display unit 100 and the handheldunit 200 will be described. The second lever 213 is used for theseparation. When the second lever 213 is moved to a second elasticmember 230 side by the user's finger, the second projection 214 exitsthe space over the first projection catch portion 133. When the imagingdisplay unit 100 in such a state is moved upward from the handheld unit200, the second projection 214 and the first projection catch portion133 does not engage with each other. As a result, the imaging displayunit 100 moves up while being guided by the first and second rails 131and 211. When the imaging display unit 100 is kept moving, the firstrails 131 and the second rails 211 are separated from each other. Withsuch an operation, the imaging display unit 100 and the handheld unit200 can be separated from each other.

Next, the position and function of the button 160 will be described indetail. As described above, the button 160 is an operation unit arrangedin the position illustrated in FIG. 3A on the imaging display unit 100.In the handheld mode described in FIG. 1, the button 160 is located nearthe grip portion 220 of the handheld unit 200. Since the button 160 islocated near the grip portion 220, the user can touch the button 160with the user's forefinger while gripping the grip portion 220 asillustrated in FIG. 1. Consequently, the user can operate the button 160while viewing the display units 110 without releasing any hands from thegrip portion 220. Since the user can perform a button operation withoutreleasing any hands, the handheld display apparatus is less likely to beaccidentally dropped. During the button operation, the user's finger isless likely to cross in front of the front cover 140 of the imagingdisplay unit 100 and appear in the captured image. In the foregoingdescription, while one button 160 is provided, in other exemplaryembodiments, a plurality of buttons may be arranged, for example, nearthe position illustrated in FIG. 3A. The user viewing the display units110 may operate the button 160 without looking at the button 160. Tothat end, the button 160 is projected or depressed so that the user canfeel the presence of the button 160 by simply touching it. The button160 may be a button other than a push button, such as, but not limitedto, a latch switch, a slide switch, a stick, a touch panel, etc., andmay be appropriately selected and arranged according to functions.

Various functions can be assigned to the button 160. A first function isto power on/off the imaging display unit 100. For example, the button160 may have a function of powering on the imaging display unit 100 ifthe button 160 is pressed or kept pressed for several seconds when thepower of the imaging display unit 100 is off. Alternatively, the button160 may have a function of powering off the imaging display unit 100 ifthe button 160 is pressed or kept pressed for several seconds when thepower of the imaging display unit 100 is on. A second function is toswitch on/off the display units 110.

For example, the display devices of the display units 110 are frequentlyturned off as appropriate to conserve power. The button 160 can have afunction of turning on the display devices of the display units 110 ifthe button 160 is pressed. The user can turn on the display units 110 bypressing the button 160 only when the user wishes to view the displayunits 110, thereby reducing the turn-on time. If operating the button160 each time is troublesome, the display units 110 may be automaticallyturned off when a predetermined time elapses. In such a case, the button160 is only used to switch on the display units 110. A third function isto change internal parameters of the imaging display unit 100. Theinternal parameters refer to parameters that include, but are notlimited to, determining brightness and contrast of the display unit 110,and controlling aperture, sensitivity, and focusing of the imaging unit.The internal parameters can include whether to superimpose a virtualobject or scene on the real scene. For example, if the button 160 ispressed, a graphical user interface (GUI) is displayed on the displayunit 110. In one exemplary embodiment, the user can change the internalparameters while viewing the GUI by combining a plurality of buttonoperations.

Other Exemplary Embodiments

Next, another exemplary embodiment will be described. FIGS. 5A, 5B, and5C illustrate a mechanism for mechanically transmitting an operationperformed on buttons on a handheld unit. A method for coupling andseparating an imaging display unit 101 and a handheld unit 201illustrated in FIGS. 5A, 5B, and 5C is substantially the same as themethod described above that is associated with the imaging display unit100 and the handheld unit 200.

FIG. 5A is a perspective view of the imaging display unit 101. Theimaging display unit 101 includes a button 161 a and a button 161 b inthe positions illustrated in FIG. 5A. FIG. 5B is a perspective view ofthe handheld unit 201. The handheld unit 201 includes a button 241 a anda button 241 b in the positions illustrated in FIG. 5B. The user canoperate the buttons 241 a and 241 b while gripping a grip portion 221.

FIG. 5C is a sectional side view when the imaging display unit 101 iscoupled with the handheld unit 201. As illustrated in the diagram, themechanism includes the button 241 a, a link 242, a compression spring243, a rotation shaft 244, a projection 245, and the button 161 a. Sucha mechanism can convert a force used to press the button 241 a into aforce that presses the button 161 a. More specifically, the link 242 ispressed against the button 241 a when receiving resilience of thecompression spring 243.

When the user presses the button 241 a in the direction P in FIG. 5C,the force is conveyed to the link 242. The link 242 rotates about therotation shaft 244 in the direction R in FIG. 5C while furthercompressing the compression spring 243. With the rotation, theprojection 245 presses the button 161 a. When the button 161 a ispressed, a control signal is generated and, for example, the state ofthe imaging display unit 101 transitions. The user can visually observethe state transition, and, for example, release the user's finger fromthe button 241 a. If the user's finger is released, the link 242 returnsto the original position by the resilience of the compression spring243. At the same time, the pressing of the button 161 a is alsoreleased. In other words, the user, through the link mechanism, canperform a button operation on the imaging display unit 101 while viewingthe display unit 110 without releasing any hands from the grip portion221.

FIGS. 6A, 6B, and 6C illustrate a mechanism for transmitting anoperation performed on buttons on a handheld unit via a wiredconnection.

An imaging display unit 102 and a handheld unit 202 will be describedbelow. A method for coupling and separating the imaging display unit 102and the handheld unit 202 is substantially the same as the methoddescribed above that is associated with the imaging display unit 100 andthe handheld unit 200.

FIG. 6A is a perspective view of the imaging display unit 102. Theimaging display unit 102 includes a first coupling unit 130. The firstcoupling unit 130 includes a first electrical contact group 134. Theimaging display unit 102 further includes a built-in control substrate170. The control substrate 170 controls a video output to display units110 and accepts a control signal generated by a button operation.

FIG. 6B is a perspective view of the handheld unit 202. The handheldunit 202 includes a second coupling unit 210. The second coupling unit210 includes a second electrical contact group 215. The handheld unit202 further includes a button group 242 in the positions illustrated inFIG. 6B. The user can operate the button group 242 without releasing theuser's hands from a grip portion 222 and without viewing the displayunits.

FIG. 6C is a block diagram illustrating an electrical configuration whenthe imaging display unit 102 is coupled with the handheld unit 202. Ifthe imaging display unit 102 and the handheld unit 202 are coupled viathe first coupling unit 130 and the second coupling unit 210, the firstelectrical contact group 134 contacts the second electrical contactgroup 215. The contact between the first electrical contact group 134and the second electrical contact group 215 establishes a wiredconnection between the button group 242 and the control substrate 170.An electrical signal indicating information that the user has pressedthe button group 242 is transmitted to the control substrate 170 via thefirst electrical contact group 134 and the second electrical contactgroup 215 (wired communication). As a result, the user can perform abutton operation on the imaging display unit 102 while viewing thedisplay units 110 without releasing either one of the user's hands fromthe grip portion 222.

FIGS. 7A, 7B, and 7C illustrate a mechanism for wirelessly transmittingan operation of buttons on a handheld unit. An imaging display unit 103and a handheld unit 203 will be described. A method for coupling andseparating the imaging display unit 103 and the handheld unit 203 issubstantially the same as the method described above that is associatedwith the imaging display unit 100 and the handheld unit 200.

FIG. 7A is a perspective view of the imaging display unit 103. A controlsubstrate 170 and a receiver 180 are built into the imaging display unit103. The control substrate 170 controls a video output to display units110 and accepts an electrical signal generated by a button operation.The receiver 180 can wirelessly receive a control signal from atransmitter 250 (described below).

FIG. 7B is a perspective view of the handheld unit 203. The handheldunit 203 includes a button group 243 in the positions illustrated inFIG. 7B. A transmitter 250 and a power supply 260 are built into thehandheld unit 203. The user can operate the button group 243 whilegripping a grip portion 223. The transmitter 250 can wirelessly transmita control signal to the foregoing receiver 180. The power supply 260supplies power to the transmitter 250.

FIG. 7C is a block diagram illustrating an electrical configuration ofthe imaging display unit 103 and the handheld unit 203. The transmitter250 and the receiver 180 are connected via wireless communication. Whenthe user presses any one of the button group 243, an electrical signal(i.e., a control signal) is generated. This control signal istransmitted to the control substrate 170 via the wireless communicationbetween the transmitter 250 and the receiver 180. In other words, theuser can control the imaging display unit 103 by operating a buttonwhile viewing the display units 110 without releasing any of the user'shands from the grip portion 223.

As described above, the handheld display apparatus according to anexemplary embodiment enables a user to easily perform a buttonoperation. The user can thus easily issue a control instruction to thehandheld display apparatus that includes the display units fordisplaying an image to the user. In addition, the handheld displayapparatus can be easily switched to a head mounted apparatus.

While aspects of the present invention have been described withreference to exemplary embodiments, it is to be understood that theaspects of the invention are not limited to the disclosed exemplaryembodiments. The scope of the following claims is to be accorded thebroadest interpretation so as to encompass all such modifications andequivalent structures and functions.

What is claimed is:
 1. A handheld display apparatus including a displayunit configured to display an image, the handheld display apparatuscomprising: a contact portion arranged in proximity to the display unitand configured to contact a head of a user; a handheld grip portionincluding bar member to be gripped by the user and anattachment/detachment unit configured to enable the handheld gripportion to attach to or detach from the display unit; and an operationunit configured to receive a manual operation and cause another unit togenerate a control signal for the handheld display apparatus, theoperation unit being—arranged either on the member or in proximity tothe member.
 2. The handheld display apparatus according to claim 1,wherein the attachment/detachment unit includes a rail member, andwherein the handheld grip portion is configured to attach to and detachfrom the display unit by engagement of the rail member.
 3. The handhelddisplay apparatus according to claim 1, wherein theattachment/detachment unit includes a lever member, and wherein thehandheld grip portion is configured to attach to and detach from thedisplay unit by an operation performed on the lever member.
 4. Thehandheld display apparatus according to claim 1, wherein the displayunit includes a coupling unit configured to enable the display unit tocouple with a head mount unit.
 5. The handheld display apparatusaccording to claim 1, wherein the operation unit is arranged on the barmember, wherein the manual operation is transmitted to the display unitthrough a link mechanism, and wherein the display unit is configured toreceive the transmitted manual operation and generate the controlsignal.
 6. The handheld display apparatus according to claim 1, whereinthe operation unit is arranged on the bar member, wherein informationabout the manual operation is transmitted to the display unit as anelectrical signal via wired communication, and wherein the display unitis configured to receive the transmitted information about the manualoperation and generate the control signal.
 7. The handheld displayapparatus according to claim 1, wherein the operation unit is arrangedon the bar member, wherein information about the manual operation istransmitted to the display unit as an electrical signal via wirelesscommunication, and wherein the display unit is configured to receive thetransmitted information about the manual operation and generate thecontrol signal.
 8. The handheld display apparatus according to claim 1,wherein the operation unit includes a button that is in a projected ordepressed state relative to the operation unit.
 9. The handheld displayapparatus according to claim 1, wherein the operation unit includes atleast any one of a latch switch, a slide switch, a stick, or a touchpanel.
 10. The handheld display apparatus according to claim 1, furthercomprising a control unit configured to, in a case where a button ispressed, cause the display unit to display an image.
 11. The handhelddisplay apparatus according to claim 1, wherein the contact portion isan elastic member.
 12. A display apparatus including a display unitconfigured to display an image, the display apparatus comprising: acontact portion arranged in proximity to the display unit and configuredto contact a head of a user; an attachment/detachment unit configured toenable a handheld grip portion including bar member to be gripped by theuser to attach to or detach from the display unit; and an operation unitconfigured to receive a manual operation and cause another unit togenerate a control signal for the display apparatus, the operation unitbeing arranged in proximity to the bar member when the handheld gripportion is attached to the display unit.
 13. The display apparatusaccording to claim 12, wherein the display unit includes a coupling unitconfigured to enable the display unit to couple with a head mount unit.14. The display apparatus according to claim 12, wherein the operationunit includes a button that is in a projected or depressed staterelative to the operation unit.
 15. The display apparatus according toclaim 12, wherein the operation unit includes at least any one of alatch switch, a slide switch, a stick, or a touch panel.
 16. The displayapparatus according to claim 12, further comprising a control unitconfigured to, in a case where a button is pressed, cause the displayunit to display an image.
 17. The display apparatus according to claim12, wherein the contact portion is an elastic member.
 18. A handheldapparatus comprising: an attachment/detachment unit configured to enablea handheld grip portion including bar member to be gripped by the userto attach to or detach from a display unit including a contact portionarranged in proximity to the display unit and configured to contact ahead of a user; and an operation unit configured to receive a manualoperation and cause another unit to generate a control signal for thedisplay unit, the operation unit being arranged on the bar member.